Papers with retrieval-augmented systems
Dissecting GraphRAG: A Modular Analysis of Knowledge Structuring for Factoid Question Answering (2026.tacl-1)
Copied to clipboard
Noriki Nishida, Rumana Ferdous Munne, Shanshan Liu, Narumi Tokunaga, Yuki Yamagata, Fei Cheng, Kouji Kozaki, Yuji Matsumoto
| Challenge: | GraphRAG integrates structured knowledge graphs into question answering . high-quality triple extraction is critical, but lacks granularity and topical coherence . large language models suffer from inherent limitations in their internalized knowledge . |
| Approach: | They evaluate module-level design choices in GraphRAG for retrieval-augmented generation . they find that triple extraction is critical for accurate and comprehensive retrieval . |
| Outcome: | The proposed framework outperforms other retrieval-augmented generation frameworks in accuracy and efficiency. |
AutoChunker: Structured Text Chunking and its Evaluation (2025.acl-industry)
Copied to clipboard
| Challenge: | Existing methods for text chunking struggle with document structure and noise . Existing approaches struggle with maintaining semantic coherence while handling complex documents. |
| Approach: | They propose a bottom-up approach to chunking that combines document structure awareness with noise elimination. |
| Outcome: | The proposed method outperforms existing methods in noise reduction, completeness, context coherence, task relevance, and retrieval performance. |
Uncovering Limitations of Large Language Models in Information Seeking from Tables (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for Table Information Seeking (TabIS) are lacking in reliable evaluation. |
| Approach: | They propose a benchmark to evaluate the table information seeking abilities of large language models . they use a single-choice question format instead of a text-based evaluation . |
| Outcome: | The proposed benchmark is more reliable than existing models and is available online. |
Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG (2025.acl-long)
Copied to clipboard
Xin Sun, Jianan Xie, Zhongqi Chen, Qiang Liu, Shu Wu, Yuehe Chen, Bowen Song, Zilei Wang, Weiqiang Wang, Liang Wang
| Challenge: | Large language models (LLMs) augmented with retrieval systems have significantly advanced natural language processing tasks by integrating external knowledge sources. |
| Approach: | They propose a method that conditions large language models to generate answers even in the absence of reliable knowledge. |
| Outcome: | The proposed approach balances accuracy with appropriate abstention, enhancing the reliability and trustworthiness of retrieval-augmented systems. |
HyQE: Ranking Contexts with Hypothetical Query Embeddings (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to rank contexts rely on similarity between contexts and queries, but these methods are limited by the number of candidate contexts. |
| Approach: | They propose a scalable ranking framework that combines embedding similarity and large language models without fine-tuning. |
| Outcome: | The proposed framework improves the performance across multiple benchmarks. |
KnowMe-Bench: Benchmarking Person Understanding for Lifelong Digital Companions (2026.acl-long)
Copied to clipboard
Tingyu Wu, Zhisheng Chen, Ziyan Weng, Shuhe Wang, Shuo Zhang, Sen Hu, Silin Wu, Qizhen Lan, Huacan Wang, Ronghao Chen
| Challenge: | Existing long-horizon memory benchmarks use multi-turn dialogues or synthetic user histories . despite rapid progress on long-term memory evaluation, there are gaps in existing benchmarks . |
| Approach: | They propose a long-form autobiographical narrative benchmark that reconstructs each narrative into a flashback-aware, time-anchored stream and evaluates models with evidence-linked questions. |
| Outcome: | The proposed benchmarks build from long-form autobiographical narratives . they show that retrieval-augmented systems improve factual accuracy while errors persist on temporally grounded explanations and higher-level inferences. |